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Abstract 

We discuss joint temporal and contemporaneous aggregation of N independent copies 
of strictly stationary INteger-valued AutoRegressive processes of order 1 (INAR(l)) with 
random coefficient a € (0,1) and with idiosyncratic Poisson innovations. Assuming that 
a has a density function of the form UG)(1 ~ ^ ^ (Oj I); with limj,-|-i 'ip{x) = 'tpi G 

(0, oo), different limits of appropriately centered and scaled aggregated partial sums are 
shown to exist for /3 € (—1,0), /3 = 0, /3 € (0,1) or /3 £ (l,oo), when taking first 
the limit as A —)• oo and then the time scale n —>■ oo, or vice versa. In fact, we give 
a partial solution to an open problem of Pilipauskaite and Surgailis [23] by replacing the 
random-coefficient AR(1) process with a certain randomized INAR(l) process. 

1 Introduction 

The aggregation problem is concerned with the relationship between individual (micro) behavior 
and aggregate (macro) statistics. There exist different types of aggregation. The scheme of 
contemporaneous (also called cross-sectional) aggregation of random-coefficient AR(1) models 
was hrstly proposed by Robinson [28] and Granger [10] in order to obtain the long memory 
phenomena in aggregated time series. See also Gongalves and Gourieroux [9], Zaffaroni [36] . 
Oppenheim and Viano [22], Gelov et ah [5] and Reran et ah [1] on the aggregation of more 
general time-series models with hnite variance. Puplinskaite and Surgailis [261127] discussed 
aggregation of random-coefficient AR(1) processes with inhnite variance and innovations in the 
domain of attraction of a stable law. Related problems for some network traffic models were 
studied in Willinger et al. [35], Taqqu et ah [33], Gaigalas and Kaj [8] and Dombry and Kaj 
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[6], where independent and centered ON/OFF processes are aggregated, in Mikosch et al. [19], 
where aggregation of M/G/oo queues with heavy-tailed activity periods are investigated, in 
Pipiras et ah [23], where integrated renewal or renewal-reward processes are considered, or in 
Igloi and Terdik [11], where the limit behavior of the aggregate of certain random-coefficient 
Ornstein-Uhlenbeck processes is examined. On page 512 in Jirak [13] one can hnd a lot of 
references for papers dealing with the aggregation of continuous time stochastic processes. 

The present paper extends some of the results in Pilipauskaite and Surgailis [23], which 
discusses the limit behavior of sums 

N \nt\ 

(1.1) te[0,oo), iV,ne{l,2,...}, 

j=l k=l 

where j G {1, 2,...}, are independent copies of a stationary random-coefficient 

AR(1) process 

(1.2) Xk = aXk-i+ek, fcG{l,2,...}, 

with standardized independent and identically distributed (i.i.d.) innovations {£k)k£{i, 2 ,...} 
having E(£i) = 0 and Var(£i) = 1, and a random coefficient a with values in [0,1), being 
independent of (£A:)A:e{i, 2 ,...} s-iicl admitting a probability density function of the form 

(1.3) - xf, xg[0,1), 

where /3 g(— l,oo) and is an integrable function on [0,1) having a limit \im.x^i'ip{x) = 
^1 > 0. Here the distribution of Xq is chosen as the unique stationary distribution of 
the model fll.2l) . Its existence was shown in Puplinskaite and Surgailis [26l Proposition 1]. 
We point out that they considered so-called idiosyncratic innovations, i.e., the innovations 
{el^'^)kez+, j G N, belonging to {xl^'^)k£z+, j G N, are independent. In [23] they derived 
scaling limits of the hnite dimensional distributions of where are 

some scaling factors and hrst N ^ oo and then n ^ oo, or vice versa, or both N and n 
increase to inhnity, possibly with different rates. Very recently, Pilipauskaite and Surgailis [23] 
extended their results in [23] from the case of idiosyncratic innovations to the case of common 
innovations, i.e., when (e^ ^)fcez+ = (£i^^)fcez+, j G N. 

The aim of the present paper is to extend the results of Pilipauskaite and Surgailis [23l 
Theorem 2.1] concerning iterated scaling limits to the case of certain randomized hrst-order 
Integer-valued AutoRegressive (INAR(l)) processes. The theory and application of integer¬ 
valued time series models are rapidly developing and important topics, see, e.g., Steutel and 
van Harn [31] and Weifi [M]. The INAR(l) process is among the most fertile integer-valued 
time series models, and it was hrst introduced by McKenzie [18] and Al-Osh and Alzaid [1]. 
An INAR(l) time series model is a stochastic process (A'fc)fcg{o,i,...} satisfying the recursive 
equation 

M-i 

(1.4) Xk = ^k,j A Eki k E {1, 2,...}, 

i=i 
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where {ek)k&{i, 2 ,...} are i.i.d. non-negative integer-valued random variables, are 

i.i.d. Bernoulli random variables with mean aG [0,1], and Xq is a non-negative integer-valued 
random variable such that Xq, {^k,j)k,je{i, 2 ,...} and (eA;)A;e{i, 2 ,...} are independent. By using 
the binomial thinning operator ao due to Steutel and van Barn [31], the INAR(l) model in 
fll.dp can be written as 

(1.5) Xk = a o Xk-i + Sk, k G {1, 2,...}, 

which form captures the resemblance with the AR model. We note that an INAR(l) process can 
also be considered as a special branching process with immigration having Bernoulli offspring 
distribution. 

Leonenko et al. [m introduced the aggregation ^ sequence of independent 

stationary INAR(l) processes j g N, where X^^'^ = aOl o -f k e Z, j G N. 

Under appropriate conditions on j G M, and on the distributions of j G N, they 

showed that the process well-dehned in L^-sense and it has long memory. 

We will consider a certain randomized INAR(l) process {Xk)k&z+ with randomized thinning 
parameter a, given formally by the recursive equation 

(1.6) Xk = a o Xk-i + Ek, /c G {1, 2,...}, 

where a is a random variable with values in (0,1) and Xq is some appropriate random vari¬ 
able. This means that, conditionally on a, the process {Xk)kez+ is an INAR(l) process with 

thinning parameter a. Conditionally on a, the i.i.d. innovations (eA;)A;e{i, 2 ,...} are supposed 
to have a Poisson distribution with parameter A G (0, cxd), and the conditional distribution of 
the initial value Xq given a is supposed to be the unique stationary distribution, namely, a 
Poisson distribution with parameter A/(l — a). For a rigorous construction of this process, see 
SectionlH Here we only note that {Xk)kez+ is a strictly stationary sequence, but it is not even 
a Markov chain (so it is not an INAR(l) process) if a is not degenerate, see Appendix]^ Let 
us also remark that the choice of Poisson-distributed innovations serves a technical purpose. 
It allows us to calculate and use the explicit stationary distribution and the joint generator 
function given in 02.41) . The authors are planning to try releasing this assumption and giving 
more general results in future research. 

Note that there is another way of randomizing the INAR(l) model 01.5p . the so-called 
random-coefficient INAR(l) process (RCINAR(l)), proposed by Zheng et ah [37| and Leonenko 
et al. [16]. It differs from 01.61) . namely, it is a process formally given by the recursive equation 

Xk Oik O Xk—l T Eky k G -(1, 2,... j-, 

where («fc)fce{i, 2 ,...} is an i.i.d. sequence of random variables with values in [0,1]. An 
RCINAR(l) process can be considered as a special kind of branching processes with immigration 
in a random environment, see Key [TS], where a rigorous construction is given on the state space 
of the so-called genealogical trees. 
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In the paper first we examine a strictly stationary INAR(l) process fll.Sp with deterministic 
thinning and Poisson innovation, and in Section |2] an explicit formnla is given for the joint 
generator fnnction of (Xq, Xi,..., X^), k G {0,1,..In Section E] we consider indepen¬ 
dent copies of this stationary INAR(l) process snpposing idiosyncratic Poisson innovations. 
Applying the natnral centering by the expectation, in Propositions 13.11 13.21 and in Theorem 
13.31 we derive scaling limits for the contemporaneously, the temporally and the joint tempo¬ 
rally and contemporaneously aggregated processes, respectively. In Section |4] hrst we give a 
construction of the stationary randomized INAR(l) process fll.bp . Considering independent 
copies of this randomized INAR(l) process, we discuss the limit behavior of the temporal and 
contemporaneous aggregation of these processes, both with centering by the expectation and 
by the conditional expectation, see Propositions 14.1114.41 Then, assuming that the distribution 
of a has the form fll.3p . we prove iterated limit theorems for the joint temporally and con¬ 
temporaneously aggregated processes in case of both centralizations, see Theorems 14.7114.131 
As a consequence of our results, we formulate limit theorems with centering by the empirical 
mean as well, see Corollary 14.141 Note that we have separate results for the different ranges 
of (3 (namely, (3 G (—1,0), (3 = 0, (3 E (0,1) and (3 G (l,cxo)), the different orders of the 
iterations, and the different centralizations. The case /5 = 1 is not covered in this paper, nor 
in Pilipauskaite and Surgailis [23] for the random coefficient AR(1) processes. We discuss this 
case for both models in Nedenyi and Pap [21]. Section [5] contains the proofs. In the appendices 
we discuss the non-Markov property of the randomized INAR(l) model, some approximations 
of the exponential function and some of its integrals, and an integral representation of the 
fractional Brownian motion due to Pilipauskaite and Surgailis [23]. We consider three kinds 
of centralizations (by the conditional and the unconditional expectations and by the empirical 
mean). In Pilipauskaite and Surgailis [23] centralization does not appear since they aggregate 
centered processes. In Jirak [13] the role of centralizations by the conditional and the uncondi¬ 
tional expectations is discussed, where an asymptotic theory of aggregated linear processes is 
developed, and the limit distribution of a large class of linear and nonlinear functionals of such 
processes are determined. 

All in all, we have similar limit theorems for randomized INAR(l) processes that Pili- 
pauskaite and Surgailis [23l Theorem 2.1] have for random coefficients AR(1) processes. On 
page 1014, Pilipauskaite and Surgailis [23] formulated an open problem that concerns possible 
existence and description of limit distribution of the double sum fll.ip for general i.i.d. processes 
j G N. We solve this open problem for some randomized INAR(l) processes. Since 
INAR(l) processes are special branching processes with immigration, based on our results, later 
on, one may proceed with general branching processes with immigration. The techniques of 
our proofs differ from those of Pilipauskaite and Surgailis [23] in many cases, for a somewhat 
detailed comparison, see the beginning of Section O 
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2 Generator function of finite-dimensional distributions 
of Galton—Watson branching processes with immigra¬ 
tion 


Let N, M, M+, and C denote the set of non-negative integers, positive integers, real 

numbers, non-negative real numbers, and complex numbers, respectively. The Borel cr-£eld 
on M is denoted by Every random variable in this section will be dehned on a hxed 

probability space (f2,^, P). 

For each k,j G Z+, the number of individuals in the generation will be denoted 

by Xki the number of offsprings produced by the individual belonging to the {k — 1)**^ 
generation will be denoted by ^k,ji and the number of immigrants in the k^^ generation will 
be denoted by Then we have 

Xk-i 

Xk = ^k,j + £k, k E N, 
t=l 

where we dehne •= 0- Here (Xq, ^kj, £k '■ k,j E N} are supposed to be independent 

nonnegative integer-valued random variables. Moreover, : k,j G N} and {sk '■ k G N} 

are supposed to consist of identically distributed random variables, respectively. 

Let us introduce the generator functions 

Fk{z) := k E Z+, G{z) := h{z) := E( 2 "i) 


for z E D := {z E C : \z\ ^ 1}. First we observe that for each /c G N, the conditional 
generator function ^{z^'° \ Xk-i) of Xk given Xk-i takes the form 


(2.1) E(zf |X,_i)=E 




Xu 


W_i) = E(4‘) n 


i=i 


for Zk E D, where we dehne 11^=1 •= 1- The aim of the following discussion is to calculate 
the joint generator functions of the hnite dimensional distributions of {Xk)kez+- Using fl2.ip . 
we also have the recursion 


Fkiz) = E(E(4^'= I Xk-i)) = EiHiz) = H{z) E{Gizf^-^) = H{z) Fk-i{Giz)) 

for z E D and k E N. Put G(o)(2:) := 2 ; and G(i)(.s) := G{z) for z E D, and introduce 
the iterates G(k+i){z) '■= G(^k){G{z)), z E D, k eN. The above recursion yields 

k-l 

F,{z) = H(z) H(G{z)) ■ ■ ■ H(G|t_i,(4) F«(G,t,(z)) = Fo(G(z)(z)) J] H(G„|(4) 

j=0 

for z E D and k E N. Supposing that E(^i 4 ) = G'(l—) <1, 0 < P(^i,i = 0) < 1, 
0 < P(^i,i = 1) and 0 < P(£i = 0) < 1, the Markov chain {Xk)k&z+ is irreducible and 
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aperiodic. Further, it is ergodic (positive recurrent) if and only if = ^) < cxo, 

and in this case the unique stationary distribution has the generator function 


j=0 


see, e.g., Seneta [221 Chapter 5] and Foster and Williamson [71 Theorem, part (iii)]. 

Consider the special case with Bernoulli offspring and Poisson immigration distributions, 
namely. 


( 2 . 2 ) 


P(6,i = l) = a = l-P(6,i = 0), 
P(£i = i) = ^e-\ i e 


with a G (0,1) and A G (0, cxo). With the special choices fl2.2p . the Galton-Watson process 
with immigration {Xk)k&z+ is an INAR(l) process with Poisson innovations. Then 


£\£ 

G{z) = 1 — a + az, H{z) = ~ e'^C-i)^ z G C, 

£=0 

hence 

G(^j){z) = 1 — + a^z, z G C, j G M. 

Indeed, by induction, for all j E 1^+, 


G(^j^i){z) = G{G(^j){z)) = aG(^j-)(z) + 1 — a = a{l — z) + 1 — a = 1 — + a^~^^z. 


Since E(^i,i) = G'(l-) = a G (0,1), P(^i,i = 0) = 1 - a G (0,1), P(^i,i = 1) = a > 0, 
P(ei = 0) = e“^ G (0,1), and 

CXD £ CO -v ^ 

^ = A < oo, 

e=i ■ £=i 

the Markov chain {Xk)k£Z+ has a unique stationary distribution admitting a generator function 
of the form 

CX) 

F{z) = ^ ^ 

j=0 

thus it is a Poisson distribution with expectation (1 — Q!)“^A. 

Suppose now that the initial distribution is a Poisson distribution with expectation (1 — 
Q!)“^A, hence the Markov chain {Xk)kei,+ is strictly stationary and 

(2.3) Fo(^o) = E(;2^°) = ^ 


By induction, one can derive the following result, formulae for the joint generator function of 
{Xq, Xi,..., Xk), k E 7^+. 
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2.1 Proposition. Under (12.21) and supposing that the distribution of is Poisson distribu¬ 
tion with expectation (1 — a)“^A, the joint generator function of {Xq,Xi, ... k G 

takes the form 

Fo,...,kizo, ...,Zk):= E{zq°z^^ ''' 


(2.4) 



l)Zi+i ■ ■■Zj-i{Zj 


1 ) 


for all fc G N and zq, ..., Zk ^ C, where, for i = j, the term in the sum above is Zi — 1. 
Alternatively, one can write up the joint generator function as 


(2.5) 


Fo,...,k{zo, ...,Zk)= exp 


A (1-a) 


K. 




('2'i'2^i+l ' ' ' Zj 1) 


where 


—1 if i = 0 and j = k, 

0 if i = 0 and 0 ^ j ^ k — 1, 

0 if 1 ^ i ^ k and j = k, 

if l^i^j^k — 1. 


2.2 Remark. Under the conditions of Proposition 12.11 the distribution of (Xo,Xi) can be 
represented using independent Poisson distributed random variables. Namely, if U, V and W 
are independent Poisson distributed random variables with parameters A(1 — a)~^a, A and 
A, respectively, then (Xo,Xi) = (U + U, U + W). Indeed, for all zo,zi G C, 

E{z^+^z^^^) = Eiizoz^fz^z^) = Eiizozif) E{z^)E{zY) 


_ gA(l-a) lo(2o2l-l)gA(zo-l)gA(zi-l) 

as desired. Further, note that formula (12.5p shows that (Xq, ... ,Xk) has a (fc + l)-variate 
Poisson distribution, see, e.g., Johnson et al. [TH (37.85)]. □ 


3 Iterated aggregation of INAR(l) processes with Pois¬ 
son innovations 

Let (Xfc)fcg 2 ^ be an INAR(l) process with offspring and immigration distributions given in 
(12.2p and with initial distribution given in (12.31) . hence the process is strictly stationary. Let 
XO) = J G N, be a sequence of independent copies of the stationary INAR(l) 

process {Xk)k€Z+- 

First we consider a simple aggregation procedure. For each X G M, consider the stochastic 
process = (S'^^^)fcez+ given by 

N 

(3.1) Sy> := - E(4'’')). k e Z+, 

i=i 
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where = A(1 — a) /c G j G N, since the stationary distribntion is Poisson 

with expectation (1 — a)“^A. We will nse —b- or Df-lim for the weak convergence of the 
hnite dimensional distribntions, and —> for the weak convergence of stochastic processes 
with sample paths in where iA(M_|_,M) denotes the space of real-valned cadlag 

fnnctions dehned on M+. The almost snre convergence is denoted by 


3.1 Proposition. We have 

^-i^(7v) ^ ^ as N ^oo, 

where X = (d4)fcez+ is a stationary Gaussian proeess with zero mean and covariances 


(3.2) 


E(A'„A't) = Cov(A'„,A't) = 


Xa^ 

1 — a’ 


k eZ^ 


3.2 Proposition. We have 

[nt\ 


n 


L/t 6 J . 


k=l 


/ teiR+ 


[nt] 


= 77 , 2 


^ Yii-W - e(aP)) 


k=l 


V 


teK+ 


'\/ A(1 + a ) 
1 — a 


-B 


as n ^ oo, where B = is a standard Brownian motion. 


Note that Propositions 13.11 and 13.21 are abont the scaling of the space-aggregated process 
and the time-aggregated process (X]i=irespectively. 

For each iV, riGN, consider the stochastic process given by 

N \nt\ 

(3,3) Sr’”':=^^(Ay-E(Af)), t e K+. 

j = l k=l 

3.3 Theorem. We have 

Hf- lim 'Df-lim (niV )“2 "Df- lim {nN)~2S^^’'^'^= 

N^oo n^oo n^oo V—>-00 1 — Q! 

where B = is a standard Brownian motion. 


4 Iterated aggregation of randomized INAR(l) pro¬ 
cesses with Poisson innovations 


Let A G (0, 00 ), and let be a probability measnre on (0,1). Then there exist a 
probability space (11,^1, P), a random variable a with distribntion P^ and random variables 











{^0) ik,jj ^k 

: k,j E M}, conditionally independent given a 

on (f2. A, P) such that 

(4.1) 

P(4j = l|a) = « = l- P(4j = 0 1 a). 

k,j G M, 

(4.2) 

F{ek = i\a) =—e~^, £ G Z+, 

ken, 

(4.3) 

P(V„ = «|«) = ^,(/_^),e-<-) y 

i G Z+. 


(Note that the conditional distribution of Sk does not depend on a.) Indeed, for each 
n e N, by lonescu Tulcea’s theorem (see, e.g., Shiryaev [301 §9) Theorem 2]), there exist 

a probability space and random variables and for 

k,j G n} on (f2„, Pn) such that 

Pn(a^”^ e B, = xq, ef’ = 4, it] = ^k,j for all k,j G {1,... ,n}) 

= [ Pn{a,Xo,{ek)k=i,{xk,j)kj=i) ^a{da) 

J B 

for all B G B(R), Xq G Z+, (4)Li ^ ^ {0> I}”''”, with 


Pn {o,A0y {.^k)k=li kj=l} ■ 


X^O 


a;o!(l — a)^o 




n 

k=l 


y4 


.-A 


n “ 

k,j=l 




(1 - a) 




since the mapping (0,1) 9 a i-G- Pn (a, (4)fc=i, (a^fcj)fcj=i) is Borel measurable for all 

XoGZ+, (4)LieZ-, ixkj)lj^,e{0Ar^^, and 


{a,Xo, (4)fe=i> {Xk,j)k,j=i) ■ Xo G Z+, (4)fc=i e Z", {xk,j)lj=i G {0,1} 


= 1 


for all a G (0,1). Then the Kolmogorov consistency theorem implies the existence of a 
probability space (11,^,P) and random variables a, Xq, Sk and 4,i for /c,j G N on 
(f2,^, P) with the desired properties (14.ip . (14. 2 p and (14.3p . since for all n G N, we have 


^{p„+i(a,xo, (4)^;!, {xk,j)lt=i) 

• 4+1 ^ (^n+lj)j=l) {Xk,n+\)k=l ^ {9, 1} , 2^71+1,n+1 e{0,l}} 

= Pn{<l,XQ, {ik)k=li {Xk,j)k,j=l) ■ 


Dehne a process {Xk)kei.+ by 

Xk-i 

Xk = ik,j + £k, k G K. 
i=i 

By Section |2l conditionally on a, the process {Xk)kez+ is a strictly stationary INAR(l) 
process with thinning parameter a and with Poisson innovations. Moreover, by the law of 


9 






total probability, it is also (unconditionally) strictly stationary but it is not a Markov chain (so 
it is not an INAR(l) process) if a is not degenerate, see AppendixThe process {Xk)kez+ 
can be called a randomized INAR(l) process with Poisson innovations, and the distribution of 
a is the so-called mixing distribution of the model. The conditional generator function of Xq 
given a G (0,1) has the form 

Fo{zo I «) := E{z^° I «) = zq e C, 

and the conditional expectation of Xq given a is ]E(Xo | a) = (1 — a)“^A. Here and in the 
sequel conditional expectations like E(z^° | a) or E(Xo | a) are meant in the generalized sense, 
see, e.g., in Stroock [32l §5.1.1]. The joint conditional generator function of Xo,Xi,...,Xfc 
given a will be denoted by To,...,fc(^o, ■ ■ ■, Zk\(y), zq, ..., Zk ^ C. 

Let j G N, be a sequence of independent copies of the random variable a, and 

let j G M, be a sequence of independent copies of the process {Xk)k&z+ with 

idiosyncratic innovations (i.e., the innovations (efc^)fcez+, j G N, belonging to {Xl^^)kez+, 
j G N, are independent) such that {xl^'^)kez+ conditionally on is a strictly stationary 

INAR(l) process with thinning parameter abO and with Poisson innovations for all j G N. 

First we consider a simple aggregation procedure. For each A^ G N, consider the stochastic 
process = {Slf^^)kez+ given by 

Sf’ := - E(XP I a'-’l)) = 5]; (x<’> - , k e Z^. 

J = 1 J = 1 

4.1 Proposition. If E(y^) < 00, then 

as N ^00, 


where (A’fe)feez+ is a stationary Gaussian process with zero mean and covariances 


(4.4) E{yoyk) = Cov Xo - 


A 


1 — a' 


,X,- 


A 


1 — a 


= AE 


a 


1 — a 


/c G E 


+ • 


4.2 Proposition. ITe have 

[ntj 


n 2 




k=l 


teiR+ 


[nt\ 


"■" E(T‘’ - I a“>)) 


k=l 


T>{ \/ A(1 -|- a) 


teR+ 


1 — a 


B 


as n ^ 00 , where B = (i?t)teK+ is 0 . standard Brownian motion, independent of a. 


In the next two propositions, which are counterparts of Propositions 13.11 and 13.21 we point 
out that the usual centralization leads to limit theorems similar to Propositions 14.11 and 14.21 
but with an occasionally different scaling and with a different limit process. We use again 
the notation = (5'f,^^)fcez+ given in (13.1 p for the simple aggregation (with the usual 

centralization) of the randomized process. 
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4.3 Proposition. If < oo, then 

v^y as N ^oo, 

where y = {yk)k&+ is a stationary Gaussian process with zero mean and covariances 
nyoyk) = Cov{Xo,Xk) = Var ^ ^ ^+- 


4.4 Proposition. If E(y^) < oo, then 



as n —)■ oo. 


In Proposition 14.41 the limit process is simply a line with a random slope. 

In the forthcoming Theorems I4.7114.13l we assume that the distribution of the random 
variable a, i.e., the mixing distribution, has a probability density of the form 

(4.5) , xe(0,1), 

where is a function on (0,1) having a limit \im.x^i'if{x) = "01 G (0,oo). Note that 
necessarily /3 g(— l,cxo) (otherwise ' 0 ( 2^)(1 ~ 3 ;)^ da; = cxo), the function ( 0 , 1 ) 9 a; '^(a;) 
is integrable on ( 0 , 1 ), and the function ( 0 , 1 ) 9 a; i—)■ '0(a;)(l — xY is regularly varying at the 
point 1 (i.e., (0, cxo) 3 x '0(1 ~ ^) is regularly varying at inhnity). Further, in case of 

fjY) = r(a+i')r(^+i) ^ ^ (O;!)’ with some a G (—l,cxo), the random variable a is Beta 

distributed with parameters a + 1 and 0 + 1. The special case of Beta mixing distribution 
is an important one from the historical point of view, since the Nobel prize winner Clive W. J. 
Granger used Beta distribution as a mixing distribution for random coefficient AR(1) processes, 
see Granger HD]. 

4.5 Remark. Under the condition fl4.5l) . for each £ G N, the expectation is 

hnite if and only if 0 > — 1. Indeed, if 0 > — 1, then, by choosing e G (0,1) with 

sup„g(i_^ i)0(a) ^ 2'0i, we have E(^y^) = + 1 ^ 2 (£), where 

Ii{e) := / '0(a)(l — a)^“'^ da ^ 6^“'^ / '0(a) da < cxo, 

Jo Jo 

hY) ■= j 0 (a) (1 - a)^"Ma ^ 201 y (1 - a)^~^ da= <oo- 

Conversely, if 0 ^ — 1, then, by choosing £ G (0,1) with sup„g(i_£ i) 0(a) ^ 0i/2, we have 
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This means that in case of /3 e (—1,0], the processes N,n eN, given 

in fl3.3l) are not dehned for the randomized INAR(l) process introduced in this section with 
mixing distribution given in fl4.5p . Moreover, the Propositions 14.1114.2114.31 and 14.41 are valid in 
case of (3 > 0, (3 > —1, (3 > 1 and > 0, respectively. □ 


For each N,nE'H, consider the stochastic process given by 


N lnt\ 

g(N.n) _ ^ I ^ g 

j=l k=l 


4.6 Remark. If /3 > 0, then the covariances of the strictly stationary process (X^ — 
E{Xk I a))fcez+ = - i^)kez+ exist and take the form 


/ \^k \ 

Cov{Xo-E{Xo\a),Xk-E{Xk\a)) =e( G Z+, 


see fl5.3p . Further, 


I Cov(Xo - E(Ao I a),Xk - E(A, | a)) = ^ ) = AE ( 


k=0 


k=0 


Xa^ 


1 — a 


k=0 


= AE 




which is hnite if and only if (3 > 1, see Remark 14.51 This means that the strictly stationary 
process {Xk — E(Afc | a))fcez+ has short memory (i.e., it has summable covariances) if /3>1, 
and long memory ii /3 E (0,1] (i.e., it has non-summable covariances). □ 


For (3 E (0,2), let (t))teE+ denote a fractional Brownian motion with parameter 

1 — (3/2, that is a Gaussian process with zero mean and covariance function 


(4.6) 


Cov(S,_,(G),S,_,(t2)) = 


,2-/3 


+ tl-^ 


— 1^2 — t] 


12-/3 


G; G £ 


In Appendix O we recall an integral representation of the fractional Brownian motion 
{f3^_0(t))tm+ due to Pilipauskaite and Surgailis |23] in order to connect our forthcoming 
results with the ones in Pilipauskaite and Surgailis [23] and in Puplinskaite and Surgailis [26] . 

123. 

The next three results are limit theorems for appropriately scaled versions of hrst 

taking the limit N ^ oo and then n —)■ oo in the case f3 E (—1,1), which are counterparts 
of (2.7), (2.8) and (2.9) of Theorem 2.1 in Pilipauskaite and Surgailis [23], respectively. 


4.7 Theorem. If (3 E (0,1), then 

Pf-lim Pf-lim A^“2 

n—>-oo N^oo 


2Xf^ir(/3) 

(2-/3)(1-/3) 
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4.8 Theorem. If (3 E (—1,0), then 

Pf-lim A-lim = (l" 2 (i+/ 3 )t)teR+, 

n—)-oo N^oo 


where V 2 {i+p) is a symmetric 2(1 + (3)-stable random variable (not depending on t) with 
characteristic function 




where 


Kg := V'l 


V2y 1 + /3' 


4.9 Theorem. If (3 = 0, then 


T>f-lim Pf-lim n'^N log N)-^ S^^n) 
n—^cxD N^oo 




where is a normally distributed random variable with mean zero and with variance Xipi. 


The next result is a limit theorem for an appropriately scaled version of hrst taking 

the limit n ^ oo and then iV —)■ cxo in the case (3 G (—1,1), which is a counterpart of (2.10) 
of Theorem 2.1 in Pilipauskaite and Surgailis [23] . 


4.10 Theorem. If (3 E (—1,1), then 

Vi- lim Pf-lim N~^n-^ = yi+g, 

N^oo n^oo 

where yi+g = {yi+git) := ® {1 + P)-stable Levy process. Here y(i +^)/2 

1 + /3 

is a positive -^-stable random variable with Laplace transform E(e“®^(i+'^)/2) = , 

9 E M+, and with characteristic function 

E(e'®^(i+«/2) = exp , 9 eR, 

where 

^ ■ 1 + /3 H 2 ; ’ 

and (i?t)tgK+ is an independent standard Wiener process. 


Next we show an iterated scaling limit theorem where the order of the iteration can be 
arbitrary in the case (3 E (1, oo), which is a counterpart of Theorem 2.3 in Pilipauskaite and 
Surgailis [23] . 

4.11 Theorem. If (3 E (l,oo), then 

Hf-lim Hf-lim (niV)“2= "Df-lim "Df-lim (niV)“2 5'(N«) _ 

n—^oo N^oo N^oo n^oo 

where := A E((l + a)(l — a)“^) and {Bt)teM.+ is a standard Wiener process. 
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By Remark [4.5[ if /9 > 1, then < oo, and hence < oo, where is given 

in Theorem 14.Ill 

In the next theorems we consider the nsnal centralization with in the cases /3 G 

(0,1) and /5 > 1. These are the connterparts of Theorems 14 . 71 ITTUl and ITm Recall that, dne 
to Remark 14.51 the expectation E(Xo) = E(y^) is hnite if and only if (3 > 0, so Theorems 
14.81 and 14.91 can not have connterparts in this sense. 


4.12 Theorem. If (3 E (0,1), then 

Pf-lim Pf-lim = Pf-lim A-lim , 

n—)-oo N^oo N^oo n^oo ^ ^ rEK+ 


where is a (1 + l3)-stable random variable with characteristic function E(e'®'^i+^) = 

0 G M, where 


UJ^{9) := 


'01^(1 f3)X^~^^ sign(0)(l+^)/2 


0 G M. 


4.13 Theorem. If (3 E (l,cxo), then 

Pf-lim Pf-lim =Pf-hm A-hm = (IT;,^ var((i-a)-i) t)ieR+, 

n—>oo N^oo N^oo n—>oo \\ j / -r 


where 1Ta 2var((i-a)-i) is a normally distributed random variable with mean zero and with 
variance Var((l — 


In case of Theorems 14.8114.121 and 14.131 the limit processes are lines with random slopes. 

We point ont that the processes of donbly indexed partial snms, and 5'^^’"'^ contain 

the expected or conditional expected valnes of the processes j G N. Therefore, in a 

statistical testing, they conld not be nsed directly. So we consider a similar process 

N lnt\ 
j = l k = l 


X 


(j) 




U) 


n 


t E 




which does not reqnire the knowledge of the expectation or conditional expectation of the 
processes X^i\ j E N. Note that the snmmands in have 0 conditional means with 

respect to a, so we do not need any additional centering. Moreover, is related to the 

two previonsly examined processes in the following way: in case oi (3 E (0, oo) (which ensnres 
the existence of E(X^'’^), k E 'L+), we have 


N L’^d 

sX-EZ 

j=l k=l 


x</> - E(xn - 


U)) 




U)) 


n 


= S. 


(N,n) 


*^1 ) 


and in case of /3 E (—1, oo), 

N \rit\ 


sX-EE 

j=l k=l 


X 


(i) 


E(X^^'^ I a^ii) 


EhX'’ - E(xP I a«))) 


U) 


n 


= S, 


n 


\N,n) 


\nt\ 


n 


S\ 


{N,n) 


for every t E M+. Therefore, by Theorem 14.71 Theorem 14.101 and Theorem 14.111 nsing 
Slntsky’s lemma, the following limit theorems hold. 
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4.14 Corollary. If (3 & (0,1)? then 


Pf-lim Pf-lim n-^+2iV-^ = 

n—>00 N^oo 


2AV^ir(/3) 
(2-/3)(l-/3) 




4eR+ 


where the process B,_p_ is given by (I4.6p . 
If (3 & (—1,1), then 


N^oo n^oo 


where the process yi+g is given in Theorem \4. 10 
If [3 E (1, 00 ), then 

Pf-lim Pf-lim =Vf-lim A-lim {nN)-^S^^’^^ = a{Bt-tBi)tm+, 

n—^oo N^oo N^oo n—^oo 

where and the process B are given in Theorem\4.11 


In Corollary 14.141 the limit processes restricted on the time interval [0,1] are bridges in 
the sense that they take the same valne (namely, 0) at the time points 0 and 1, and especially, 
in case of (3 E (1, 00 ), it is a Wiener bridge. We note that no connterparts appear for the rest 
of the theorems because in those cases the limit processes are lines with random slopes, which 
result the constant zero process in this alternative case. In case of (3 E (—1,0], by applying 
some smaller scaling factors, one could try to achieve a non-degenerate weak limit of 
by hrst taking the limit N ^ 00 and then that of n —)■ cxo. 


5 Proofs 

Theorem 14.71 is a counterpart of (2.7) of Theorem 2.1 in Pilipauskaite and Surgailis [23]. We will 

present two proofs of Theorem 14.71 and we call the attention that both proofs are completely 

different from the proof of (2.7) in Theorem 2.1 in Pilipauskaite and Surgailis [23] (suspecting 

also that their result in question might be proved by our method as well). Theorems 14.81 and 

14.91 are counterparts of (2.8) and (2.9) of Theorem 2.1 in Pilipauskaite and Surgailis [23]. The 

proofs of these theorems use the same technique, namely, expansions of characteristic functions, 

and we provide all the technical details. Theorem I4.10l is a counterpart of (2.10) of Theorem 2.1 

in Pilipauskaite and Surgailis [23] . We give two proofs of Theorem 14.101 the hrst one is based 

on expansions of characteristic functions (as the proof of (2.10) of Theorem 2.1 in Pilipauskaite 

and Surgailis [23]), the second one reduces to show that belongs to the domain of normal 

attraction of the ^^-stable law of Yi+is. Theorem 14.111 is a counterpart of Theorem 2.3 in 
^ _ 2 

Pilipauskaite and Surgailis [23]. The proof of Theorem 14.111 is based on the multidimensional 
central limit theorem and checking convergence of covariances of some Gaussian processes. 

The notations 0(1) and |0(1)| stand for a possibly complex and respectively real sequence 
(afc)fcgN that is bounded and can only depend on the parameters A, 'ipi, f3, and on some hxed 
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m G N and 9i,... ,9m G M. Further, we call the attention that several 0(l)-s (respectively 
I 0(1)|-s) in the same formula do not necessarily mean the same bounded sequence. 

Proof of Proposition [2TT]. First we prove fl2.4p by induction. Note that by fl2.3l) the statement 
holds for k = 0. We suppose that it holds for 0,..., k, and show that it is also true for k + 1. 
Using fl2.ip it is easy to see that 

Fo,...,k,k+i{zo, Zk+i) = E (^Zq° ■ ■ ■ 

= E E I Xo,..., X,) ) = E E \ X,)) 


= E - a + azk+if'^^ . 

On the one hand, for any zq, ..., Zk+i G C, by the assumption of the induction, 

^o,...,A:,fc+i(^o, ■■■,Zk, Zk+i) = • • •, Zk-1, Zk{l -a + azk+i)) 



A 

1 — 0 


(1 - o)(zfc+i - 1) + ^ \zi 


■ ■ ■ Zj—li^Zj 1) 


+ Sumi + Zk{l - o + azk+i) — 1 


with 


Sumi := ^ \zi-l)zi+i---Zk-i[zk{l-aZrazk+i)-l]. 

On the other hand, the right hand side of fl2.4p for k + 1 has the form 


exp 


A 


1 — 0 


\zi - l)zi+i ■ ■ ■ Zj-i{zj - 1) + Sum 2 + Sums 


where 


Suma = \zi - l)zi+i ■ ■ ■ Zk-i{zk - 1) 




{Zk - 1) + \zi - l)zi+i ■ ■ ■ Zk-i{zk - 1), 




and 


Sums = "{zi - l)zi+i ■ ■ ■ Zk{zk+i - 1) 

Osgis£fc+l 

('^fc+1 1) “h (Zfc 1) 1) “1“ ^ ^ ^ ('^fc+1 1) • 


Since 

Sumi = a^~\zi - l)zi+i ■ ■ ■ Zk-i{zk - 1) + - l)zi+i ■ ■ ■ Zkizk+i - 1), 
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in order to show (I2.4p for /c + 1, it is enough to check that 


(1 - a){zk+i - 1 ) + Zk{l -a + azk+i) - 1 = {zk - 1) + {zk+i - 1 ) + a{zk - l){zk+i - 1 ), 


which holds trivially. 

Now we prove (12.51) . In formula (12.41) . for hxed indices 0 ^ i ^ j ^ k the term in the sum 
gives 


{Zi - l)Zi+i ■ --Zj^i^Zj - 1 ) 

= {Zi--- Zj -1)- (zf- Zj_i - 1) - {Zi+i ■■■Zj-l)Zr {Zi+i ■ ■ ■ Zj_i - 1), 


meaning that the sum consists of similar terms as in fl2.5p . We only have to show that the 
coefficients coincide in the formulas fl2.5l) and fl2.4p . In fl2.5l) the coefficient of Zi - ■ ■ Zj — 1 is 
A(1 — In (12.4p this term may appear multiple times, depending on the indices i 

and j. If i = 0 and j = /c, then it only appears once, with coefficient Aq!-^“Y(1 — a), that 
is the same as in (12.5p . However, if i = 0 and 0 ^ j ^ k — 1 in (12.5p . then the term also 
appears when the indices are i and j + 1 in (12.4p . meaning that the coefficient is 


A 


a- 




a 


1 -a J 


\a^~ 


which is the same as in (12.5p . Similarly, if 1 ^ i ^ k and j = k in (12.5p . then the term also 
appears when the indices are i — 1 and j in (12.41) . meaning that the coefficient is 


A 



1 -a ) 


Xa^~ 


which is the same as in (12.5p . If l^i^j^k — 1 in (12.51) . then the term appears three more 
times, for the index pairs {i — 1, j), {i,j + 1), (i — 1, j + 1) in (12.4p . resulting the coefficient 


/ 

\1 — a 


—i 


1 — a 


aO'+i)-* 
1 — a 


+ 


1 -a ) 


. 1 - 2 « + 

Xa^ - 

1 — a 


Xa^ *(1 — a), 


which is the same as in (12.5p . This completes the proof. 


□ 


Proof of Proposition 13.11 The distribution of Xq is a Poisson distribution with parameter 
(1 — a)“^A, thus Cov(Xo,Xo) = Var(Xo) = (1 — a)“^A. By (12.4p . we have 


Fo,k{xo,Xk) = 




= ^A[o''(a;o-l)(a:i,-l)+(xo-l)+(a:fc-l)] 


for all xo,Xk^E and fc G N. Consequently, 


E{XoXk) 


d'^Fo^k{xo,Xk) 

dxodxk 


(a:o,Xfc)=(l,l) 


Xa^ X^ 

1 — a (1 — a)^ ’ 


keN, 


since 

^ ^dx^^dxk^^ ^ (1 ^ “ 1) + Fj{a^{xk - 1) + 1) + Fo,fc(a;o, x*,) 
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Hence we obtain the formula for Cov(Xo,Xfc). The statement follows from the multidimen¬ 
sional central limit theorem. Due to the continuous mapping theorem, it is sufficient to show 
the convergence S[^\ ..., {Xq, Xi,, X^) as N ^ oo for all k G 

For all /c G Z+, the random vectors {Xq^ — j G N, are 

independent, identically distributed having zero expectation vector and covariances 

Cov(X<f,X<f) = Cov(xy,y“_,,|) = ^^^. ieN, 

following from the strict stationarity of and from the form of Coy{Xo, Xk). □ 

Proof of Proposition 13.21 It is known that 

Mk := Xu - E{Xu I =Xu- {Xu-i E(ei,i) + E{ei)) = Xu - aXu-i - A, A: G N, 

are martingale differences with respect to the hltration := (^{Xq, ... ,Xu), k G Z+ with 

(5.1) E{M^ I = Xu-i Var(ei.i) + Var(£i) = a(l - a)Xu-i + A, A; G N. 

The functional martingale central limit theorem can be applied, see, e.g., Jacod and Shiryaev 
[121 Theorem VIII. 3.33]. Indeed, by ergodicity, for each t G M+, we have 

1 A 

— ^E(M^ I ^a(l — a)--h a'^A = (1-|-a)AA as n —)■ oo. 

k=l 

Moreover, the conditional Lyapunov condition holds, namely, again by ergodicity, 

[nt\ 

— E{M^ I Xu-i) ^0 as n^oo, 

k=l 

since there exists a second order polynomial P such that E{M^ \ Xu-i) = P{Xu-i), k E N, 
see Nedenyi m Formula (8)], or Barczy et ah [21 Lemma A.2, part (ii)] together with the 

■y 

decomposition Mu = — ^{^k,j)) + {^k — E(£a:)), A; G N. Hence we obtain 

/ 1 A 

as n —)■ oo. 

V V k=l / i6R+ 

We have Xu = aXu-i + Mu + A, A: G N, thus E(Xfe) = aE{Xu-i) + A, A: G N, and hence 
Xu - E(Xfc) = a{Xu-i - E(A:fc_i)) Mu, A; G N, yielding 

k 

Xu - E{Xu) = a\Xo - E(Xo)) + a’^-^M^, keN. 

1=1 
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Consequently, for each n G N and t G M+, 


[ntj 


[ntj 


[nt} k 


- E(A-J) = -j=(X„ - E(A„)) E ^ E E 


a 




= (Xo-E(Xo)) 


= (Xo-E(Xo)) 


a_aM+i 


k-j 


(1 - a)y/n 

tt_aLrxtJ+i 1 

(1 - a)y/n 


'' .7 = 1 k=j 

1 - 


.7 = 1 /c=j 

[ntJ 


^ Vm, 

j=i 


1 — a 


implying the statement using Slutsky’s lemma. Indeed, n q/HJ i+^Mj converges! 

Li and hence in probability to 0 as n —)■ cxo, since, by fIS.ip . 


m 


E(|M,|) ^ ^E(M2) = ^«(l-«)E(X,_i) + A = VA(1 + «), 


and hence. 


E 


as n —)■ oo. 


\nt\ 




i=i 




V -^(1 + Cl ) 


n 


[ntJ 

i=i 


[np-j+l _ 


v/A(l + a) a(l 


n 


1 — « 


^ 0 


□ 


Proof of Theorem 13.31 For all iV,m G N and all ti,... ,tm ^ E+, by Proposition 13.21 and 
by the continuity theorem, we have 


N 


1 ^^(N,n) Q(lV.n)x n ^5^+^ rO) 


n 


(S, 




,Si 


1 — 0 


5^(5? asn^cx). 


i=i 


where = {Bl^’)teR+, j e {1,..., A^}, are independent standard Wiener processes. Since 

1 ^ 

^ E(b“. .... db = (B«...... B.„). Af 6 N, 

we obtain the hrst convergence. 

For all n G M and for all ti,... ,tm ^ E+ with ti < ... < tm, m G N, by Proposition 
13.11 and by the continuous mapping theorem, we have 


AP/2 


( [ntij L^imJ \ 

V y \ 

/ , ■ ■ ■ , 2_^ I 

k=l k=l ) 


V 


/ /\ntl\ \ritm\ \ \ 

Mm f 0, Var f ^ Tfc,..., ^ Xk\ j , 


iV —)■ cx). 
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where {Xk)kez+ is the stationary Gaussian process given in Proposition 13.11 and 


/\nti\ \ntm\ 

Var( A’fc 

k=l 


\ k=l 



A 


[nti\ \ntj\ 


rr^EE 


1 — a 


a 


\e-k\ 


k—l 1—1 / 

By the continuity theorem, for all 6*i,..., 6^^ G M, m G N, we conclude 


jim E l^exp |i ^ 


= exp 


m [ntii \ntj\ 


2n(l — a) ^ ^ 
1=1 


EE''-»>EE“'“'} 

i=i j=i k=i 1=1 ^ 


(l + a)A ^ , 

^ ~ 2(l-a)2 


as n —)■ oo. Indeed, for all s,fGM+ with s^t, we have 


n 


[nsj \nt\ 

EE 

k=l 1=1 
[nsj 


[nsj k-1 


a' 


e-k\ _ 


ww„‘-' + M + iw w 

Cf^ ly-i Z^^^ Z^^J 


[nsj \nt\ 


n 


a 


e-k 


k=l i=l 


n n 


k=li=k+l 


1 a — [nsj 1 a — ai”*i 


n 


(5.2) 


E Uc • 

T 

k=l 

1 


n(l — a) 
1 


+ 

a n n 


[nsJ 

E 

k=l 


1 — a 


1 — a A I nsJ 
\ns\a — a —:- | + 


n(l — a) 
1 + a [nsJ 


1 — a / n 

1 _aM 


[nsJa-aL-d-M+i 


1 — a 


a 


1 — a n (1 — a)^n 

as n ^ oo. This implies the second convergence 

Proof of Proposition 14.11 We have 

A 




1 — a 


EX. 


1 — 0 / 


\ 

r r A 

\ 1 

) = E 

EfXfc ^ 

o 

/ 

L V 1-0 

Ji 


= 0, k ez 


and hence, for all k E Z 


+ ) 


Cov(Xo-^^,Xfc--^) =E 


1 — a' 


= E< E 


Xn- 


A 


1 — a 


1 — a 


X,- 


A 


1 — 0 
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Xn 


a 


A 


1 — 0 


X, 


+ ) 


A 


1 — 0 


= E 


Ao^ 

1 — o/ ’ 


□ 


(5.3) 







































where we applied (13■2p . Now the statement follows from the multidimensional central limit 
theorem in the same way as in the proof of Proposition 13.11 □ 

Proof of Proposition [ 4 T 2 I For each n G N and each f G M+, put 

[nt\ 

For each m G N, each ti,... ,tm G K+, and each bounded continuous function g : —)■ M, 

we have 


E(j(f,y,.... TZ’)) = / n'ATZ ’,..., C) I a = «) P„(da) 

A 


yn)^ 


yn) 


^(n)^ 


/o 


lnti\ [ntmj 


n 


1 — a 


a = a] Pa (da). 


k=l ^ k=l 

Proposition 13.21 the portmanteau theorem and the boundedness of g justify the usage of the 
dominated convergence theorem, and we obtain 


hm E{g{fi:;\...,T,Z>))= I E( ^7 




1 — a 


-Bt, 


\/ -^(1 + o ) 


= EU 


V^A(1 + a) ^ V'A(1 + a) ^ 

■ ■ ■, —;- J^tr, 


= eU 


1 — a 
\/ -^(1 + 


1 — a 


1 — a 
a = a] Pa (da) 


Bt^ Pa (da) 


«) R 


a) 


-B, 


im I I 5 


1 t-i 7 7 -| 

1 — a 1 — a 

hence we obtain the statement by the portmanteau theorem. 


□ 


Proof of Proposition |4T^ For all k G Z_|_, by the strict stationarity of and fl5.3p . 

we have 


(5.4) 


Cov(Xo,Xfc) =E 


= E 


Xn -E 


A 


1 — 0 


Xo- 


A 


= AE 


a 


1 — 0 


X,- 


smce 


X,- 


E 


= E<^E 


1 — 0 

A 


+ A^ Var 


A 


Xfc-E 

A 

1-0 
1 


A 


1-0 
+ E 


1-0 


-E 


1-0 


1 — 0 / Vl — o 


1 — o / ’ 
A 


X, 


A 


E 


A 


1-0 


= E 


A 


1-0 


-E 


1 — 0 / Vl — o 
A 


E 


A 


1-0 


E Xfc- 


1-0 

A 

1-0 


o 


o U = 0 
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for all G Zj 


The statement follows from the multidimensional central limit theorem as in the proof of 
Proposition 13.11 Indeed, for all k G Z_|_, the random vectors 


- AE 


1 — a 


- AE 


1 — a 


- AE 


1 — a 


, J e N, 


are independent, identically distributed having zero expectation vector and covariances 


Cov(Jf<f, A'W') = Cov(A'a', A'l 


(i) • 

K2-Gf 


= AE 


a 


K 2 -GI 


1 — a 


+ A^ Var 


1 — a 


for j G N and G {0,1,..., A;}, following from the strict stationarity of and from 

the form of Cov(Xo,Xfc) given in fl5.4p . □ 

Proof of Proposition 14.41 , We have a decomposition k G Z+, with 

A 


Rf := E(Af> I a<‘l) - E(A<‘') = 


A 


1 — oP) 


E 


l-aW r 


k G Z,+ . 


We have 


\nt\ 




( 1 ) 

k 


k=l 


teK+ 


n I 1 — aX) 


E 


A 


1 — aP) 


teK+ 




1 — a 


E 


1 — « 


teR+ 


as u ^ cx). Moreover, by Proposition |4.21 Pf-hm,^^oo - 1/2 exists, hence 


\nt\ \ 

EX 

k=l J 




0 as n —)■ cxo. 


teK+ 


implying that for all m G N and all ti,..., fm G M+, we have 

Ai) 1 P 


[ntml 

iTX.---.-y.si 

n ^ n ^ 

k=l k=l 


0 as n —)■ cxo. 


By Slutsky’s lemma we conclude the statement. 

First proof of Theorem 14.71 By Remark [4.51 condition (3 G (0,1) implies E(j-^) < 00 
Hence, by Proposition 14.11 and the continuous mapping theorem, it suffices to show that 


□ 


(5.5) 


Vf- lim 


" k=i J 


4eR+ 




B^_p. 
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We are going to apply Theorem 4.3 in Beran et al. [3] with m = 1 for the strictly stationary 


Ganssian process (3^fc/'\/Var(3^o)) , where, bv fl4.4p . 


hence 


Var(3^o) = AE 


Cov 


1 — a / ’ 


3^0 


Coy{yo,yk) = XE 


a 


1 — a / ’ 


k e Z+, 




E ^ 

1—a 


/c G Z 


Vvar(3^o)’ ^Var(3^o)/ ^1-“^ ’ 

In order to check the conditions of Theorem 4.3 in Beran et al. [5], hrst we show that 
(5.6) ^ = k^ J a^{l — a)^~^'ijj{a) da ^ ipiTlf]) as k ^ oo, 

meaning that the covariance fnnction of the process {yk)k£Z+ is regularly varying with index 
—(3. First note that, by Stirling’s formula, 

lim f - aF-V. da = Ito r(« 


k^oo 


= ipiT{f3) lim 


k 


k^oo y k P \k ~\~ p 


k+l3 


e-* = i,iT[l3). 


Next, for arbitrary 6 G (O,'0i), there exists £ G (0,1) such that |'0(a) — V'll ^ 6 for all 
a G [1 — £, 1), and hence 


k^ 


n 


»i 


/ a^(l — a)^ ^|' 0 (a) —-^il da ^ (5sup/ a^(l — a)^ ^ da 
n-£ fceN Jo 


can be arbitrary small. Further, observe 


k^ 


f*l — £ 


"(1 — aY ^ 


fc^(l — e) 


k /-I—£ 


(1 — aYp!{a) da 




k^{l — e) 


k /-i 


(1 — a)^'p{a) da = 


k^{l — eY 


—)■ 0 as /c —)■ oo. 


In a similar way, we have 


k^ 


—£ 


^1—e 


= (1 - a)^-Vi da ^ V>iA;^(l - ef / (1 - af-^ da 


^ y>ifc^(l — eY [ Y ~ (^Y ^ da = pJi -)■ 0 as fc —)■ cx), 

Jo P 


hence 


'•I —£ 


k^ / a^(l — a)^ ^l'^(a) — y^il da —)■ 0 as fc —)■ oo. 
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implying (15.Gp . Applying fl5.6p . we conclude 


Cov 


3^0 




= 


E ( ^ 

1—a 


'Var(yo) YVar(yo) 

as /c ^ oo. Consequently, by Theorem 4.3 in Beran et al. [3], 

1 yk 


_' ^ir(/3) 

E(A) ^ilh) 


1—^ 
n 2 


\nt\ 

E 


... vdihEi 


—t i_l = Oi_l, 


as n ^ oo, 


teK+ 


where Z-^ is the Hermite-Rosenblatt process dehned in Dehnition 3.24 of Beran et al. [3], 
and 


Li(n) = 


V'ir(/3) 


Cl, n e N, 


with 


Ci = 


E(jy;)'^” .’ . (l-/3)(2-/3) 

The fact that the Hermite-Rosenblatt process Z, coincides in law with is shown 

in Beran et al. [3], see Definition 3.23, the representation in formula (3.111), and page 195 of 
[3] for details. Hence we obtain the statement. □ 


Second proof of Theorem 14.71 As in the hrst proof of Theorem 14.71 it suffices to show 
fl5.5p . As for every n G N the process X]i=i t G M+, is Gaussian, so is the limit 

process. Also, it is clear that both processes have zero mean. Therefore, it suffices to show that 
the covariance function of r/c, t G M+, converges to that of the limit process 

in fl5.5p . By fl4.4p . the covariance function of J2^^{yk, t G M+, for any ti,t 2 G M+ 

takes the form 


( [ntij \nt 2 \ \ /\nti\\nt 2 \ |fc_£| \ 

^ E » = E E E 

k=l i=\ ) \ fc=l £=1 / 


By fl5.2p . for time points 0 ^ ^ t 2 , we get 


[ntij [nt 2 j 

A;EE« 


1 YA" YA (1 - a^) [nfij - a (1 - ^ 


1 — a 


(1 -«)' 


k=l i=l 

('5 7 ') ~ 1 ) + (1 — tt ^)/2 ~ 1 ) + (1 — «^)/2 

^ (l-a)3 ^ (l-a)3 

Q,(Q,Ri2j-Lntij — 1) + ([nt2j — L^Hj)(l — Q!^)/2 


(l-a)3 

We are going to show that for any 0 ^ ^ ^2 we get 

^-2+0Tu>f - 1) + {[nt 2 } - [ntij)(l - a2)/25^ 

^ (l-«)3 J 

^ r ^ " (2 -mi- p) 
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as n ^ oo, where the equality follows with repeated partial integration. This will imply that 
the limit of the sequence of the covariance functions in question is 

2\^plT{f3) - \t2 - 

(2-/3)(l-/3) 2 ’ 


that is the covariance function of a fractional Brownian motion with parameter 1 — (3/2 mul¬ 
tiplied by ^/2\^plT{(3)/{{2 - /3)(1 - (3)), as desired. 

By substituting a = 1 — y/n we get that 


- 1 ) + {[nt 2 \ - [nh\){l - a‘^)/2 
' (l-a)3 


= 


= 


1 Q(QL’^i2j-NlJ _ 


l) + (K,J-[nf.J)(l-a ^)/2 _ 

(1 -a)3 


'0 L 


1 - 


n 


1 - 




n 


-1 

yV\ 1 


+ (\nt2\ - Lni.J) (l - (l - lY) tj (/Y (l - f) ^ 

pn 

= / Dn{y)dy 


y\ ^y 


with 

Dn{y) ■■= 


1 - 


y 


n 


1 - 


y \ \nt 2 \-\nt 1 \ 


nJ 


-1 + 


[nt2\ - [nil] 


n 


2 / 1 - 


JL 

2n 


(1 


for y G [0,n]. First note that, for any e G (0,1) and n> 1/e, we have 


Dn{y) dy 


1- 2+ (^t 2 -ti + ^ y^ / ^^p (^1 - 0 dy 
^ f {l-2y + {t 2 -ti + l)y)y^-^Yj (^1 - 0 dy 


'*1 — 6 


(5.8) 


= {t 2 — h + d) I (n{l — a)Y ‘^'i(j{a)nda 


£ 


= {h — ti + 3)n^ ^ (1 — a)^ da 

Jo 

^ {h —ti + 3)n^~^e~‘^ f (1 — a)^'i(>{a) da —)■ 0 , n ^ 00 . 

Jo 

We are going to show that 

p'fie poo 

/ Dn{y) dy^iJi / (e-^h 2 -n) _ ^ ^ yP-s ^y^ 


n ^ 00 . 


n 
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The pointwise convergence is evident, and we can give a dominating integrable fnnction proving 
the above convergence. 

Note that 


1 - - 
n 


y \ [nt 2 i-[nti\ 




= 1 - ([ntaj - 


k=2 


[ntaj - fy\’^ 

k j \ n, 


where for any ?/ G [0,1] we have 

\nt 2 \-\nt\\ 


E 

k=2 


[ntsj - [ntiW ( y\k 


k 


n 


< y^ - [riti\) ■ ■ ■{[nt 2 } - -k + 1) 


k=2 


kl 




^ ^2 ^ (^2 -ti + 1)^ _ 


k=0 


k\ 


= y e 


Choose £ G (0,1) snch that for every x G (1 — e, 1) we have 'ip{x) ^ 2-^i. Then for any 
n > 1/e, applying Bernoulli’s inequality, we obtain 


\Dn{y)\dy = 


y\ \nt 2 \-\ntl\ y 

1--) -i + (Lnt2j-htiJ)- 

n/ n 


y_ 

n 


I _y\ ^ y{[nt 2 \ - [nti\) 

nJ 2n 


< 


212—^1+1 I y 


y e 


n 


+ - y{t 2 -ti + l)+y 


^2 — tl + 1 


1/^ ^-0 (1 - ^ ) d|/ 


y^ ^0 (1 - 0 dy 


^ 201 (e*2-*i+^+ 2(^2-0 + 1)) / y^-^dy<oo. 

Jo 

Similarly to (I5.8jl . for any n > 1/e, one gets 

/ TIE /*Tl£ 

\Dn{y)\dy^ j (2 + 0-0 + l)/"^0 (1 - 0 d|/ 

/ ne poo 

y^~‘^ dy ^ (0 - 0 + 3)201 J y^~‘^ dy < 00 . 

So the function 

20i(e*’^ + 2(0 — fi + ^l[o,i)(2/) + (0 “ 0 + 3)201?/^ ^l[i,oo)(2/) 

can be chosen as a dominating integrable function. 


□ 


26 
















Proof of Theorem 14. 8L To prove this limit theorem it is enough to show that for any n G N, 


A- lim N-^ = (LntjP 2 (i+/ 3 ))teM+. 


N^oo 

For this, by the continuous mapping theorem, it is enough to verify that for any m G N, 

N 


7V-2(i^ /xj- 


i=i 


hi) 




1 — ab) 


as N ^ oo. So, by the continuity theorem, we have to check that for any m G N and 
6 * 1 , • • •, G M the convergence 


N 


E exp < i ^ Y ( 


k=l 


i=i 


A 


hi)_ 

1 - ob) 


= E exp AiV 




E I exp < iN 2 (i+/ 5 ) (x, 


k=l 


A 


1 — a 


n N 


^ E as iV ^ oo 

holds. Note that it suffices to show 


0 JV := N 


1 - E exp < iN 2 (i+/ 5 ) YOk iXk - — 


k=l 


A 


1 — a 




k=l 


2(l+/3) 


as N ^ oo, since it implies that (1 — Qn/N)^ —)■ e as N ^ oo. By 

applying fl2.4p to the left hand side, we get 


0A1 = NE 


= iVE 


/ iW 2(1+/3) 0^ 

no,...,m— 1 1 ^ ) ■ 

AN W+me 

• 5 ^ 


N / 



= N (l 

_ gT^2l;v(a)A 


Jo ^ 

/ 

^m—1 1 *^) • 

= E(h"h‘ • 

^Nm—1 1 ^ A 
' ^m—1 \ ) 


a e 




An{o) '■= 


i{9i + ■ ■ ■ + 9m) 

A^2(1+/?) 


E 
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for a G [0,1]. Let us show that for any e G (0,1) we have sup„g(o,i-£) |-^^Ar(a)| ^ 0 as 
N ^ oo. Using flB.2p . for any e G (0,1) we get 


sup 7V|A7v(a)| = sup N 

a£(0,l—e) aE(0,l—e) 


k=l 






,fc=i 




as N ^ oo, since /3/(l+/3)<0. Therefore, bv Lemma IB.2[ substituting a = l — z i+^, 
the statement of the theorem will follow from 


u 


(5.9) 


limsupTV / 

N —^CXD — £; 

roo 

= lim sup / 


1 _ eT^^JvU) 


(1 — a)^ da 


N^oo Je—^N 1 +-^ 

for all e G (0,1) and 

»i 




( 6 . 10 ) 


with 


lim lim sup 

£ 4.0 N^oo 


N 


= lim lim sup 

£4.0 A^—>cxD 


' (l-eT^"^^(“))(l-a)^da-J 

^CX) 1 / 1 \ . 

1 m ~ t+b V / 


le-^N W 


= 0 


/ ;= 


1 - e~^ (^^=1 ®'=) ^ d^ 


k=l 


1+/3 


(1 - e-^)z-( 2 +^) dz = 


'^Ok 

k=l 


2(l+/3) 


where the last equality is justihed by Lemma 2 . 2.1 in Zolotarev [3H] (be careful for the misprint 
in [3S]: a negative sign is superfluous) or by Li [13 formula (1.28)]. Next we check 05.91) and 
( 1 ^ . 

By Taylor expansion, 

^ ^ ^ ^ N~^(^ 0 ( 1 ), 


iAT 2 ( 1 +^), 


1 _ 3 _ 3 

1-iN Ai+fS)0g = -N i+/3-T + jv zci+zs) 0(1) 



































for all £ G {1,..., m}, resulting 


(5.11) 


\zN Am ( 1 


zN i+zs / 2 

1 1 
for z > N 1+/3. Indeed, for z > N i+^, we have 

1 


HYI.,0k) , sO(i) , 0(1) 

“r 1 + 


]S[2{i+p) N^+P 


A 


N 


zN^+P 


^(e‘^ - 1 - iN~^^)ek) 

1 ^ 


k=l 


Y. 


zN^+P 


or (' 


iTV 2(1+/3)( 


1 ) 


giiV 2lT+^(e^^j+...+0^._i)^^iAr 


E 

k=l 


0(1) A 

1 ' 3 ) 

2iVl+^ 7\/'2(1+,5)/ 


01 


+ 


E (1 + ^’ 


'^Oi^ I 0(1) ^ 

zN^ J ViV2Ci+<9) J 




3^^m\ 

_/Y2(1+/3) / \_/Y2(1+/3) _/Yi+/3/ 


Er.,€ , 0(1) , 0(1) , 0(1) 

“r r? 1 “r 3 “r 


2A^1+)9 ]\f2(l+p) 

v2 


Ari+(j 


iV2(l+/3) ziVl+'3 


(EEiOt) , 0(1) , 0(1) 

1 “T 


2iVi+/3 

since by Bernoulli’s inequality 


yielding that 


3 I 2 ? 

N 2(l+/3) 


ziV 1+/5 




- 1 


7 — t m 

^ ^ ^ - 


zN 1+/3 zN ^+P ’ 


1 - 


j-i- 


= 1 + 


0 ( 1 ) 


zN 1+/3 / ^iV 1+/3 

By fIS.lip . for 2 ; G [1, 00 ) and for large enough N we have 


\zN^+pReAiq{l - z 1 +/ 3 ) = 


Re 


0a)\ ^ ReO(l) 

iV2(l+/3) / iVW 


^ ^ 0 , 


N^+P 


hence we obtain 

poo 


(5.12) 


'1 


< 


1 - e 


\zN^A n{1-z-^N W) 


2"0+2) 


1 ^ gA.7VW Re A^(l-.-iV-W) \ ^-((3+2) ^ 2 / ^"0+2) 


< CXO. 
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Again by fIS.lip . for e G (0,1), 2 G (e ^+f> , l] and for large enongh N, we have 


XzN^+i^AMil- z~^N 1+/3 


< 


MEZiOkf ^ ^ 10 ( 1)1 ^ 10 ( 1)1 

2 ]\[2{1+I3) iVW 






0 ( 1)1 


+ ^T^ + g| 0(1)1 1 ^^10(1)1^10(1)1, 

N 2(i+/3) 


since N 1+/3 < ze. Hence, using fIB.Sp . we obtain 

^-(2+/3) 

XzN^An (l-2-iAf" w) 


r . 

^ gA2AfWAjv(l-2“iV W) 

Je-i-N T+P 



< 


XzN^+i^ An[ 1 - z 1 +^) 


z-{2+0) 


Je-iN W 
^ |0(l)|el°(^)l [ z-^^+f^^dz < 00 , 

Jo 

which, together with (I5.12p . imply (15.Qp . 

Now we turn to prove (I5.10p . By (IB.ip . we have 


re-^N i+? 




ce-^N i+P 


< 


-^^(Z)fc=l ^fc)^ ^-(2+0) 
2 ^ 




^ a \2 /"e'^V 


A(Er=i ou) 


z-d+0) = 


a(e:=i^a 


^2 / 1 


2(-/3) VeiVW 


-0 


0 


as iV —)■ cx), hence fIS.lOp reduces to check that lim^j^o linisupjy^oo-^Af,£ = 0^ where 


lN,e '■ — 


^\znt+bam{i-z-^n ^) _ ^-^{T,k=iek? 


Je-i-N T+p 
Applying again (15.lip , we obtain 


z-i^+0) 




-¥(Er=ie/cd 


e 2 


2(i+/3) 0(1)+W W 0(1) _ ^ 


^-(2+0 


Je-iN W 

Here, for e G (0,1) and 2 ; G (£“^iV“W, 00 ), we have 

0(1) + iVW 0(1)| ^ z{N~^(^) +£)|0(1)|, 

and hence, by fIB.Sp . we get 


2(i+/3) 0(1)+1V T+P 0(1) _ ^ 


^ \zN~^(^ 0(1) + ivw 0(1)1 


w?To(i)+w wo(i) 




(jV +e)| 0(l)|e^(^ 2(1+^)+e)10(1)1 _ 
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Consequently, for large enough N and small enough e G (0,1), 

$ (A'-’t™ +e)| 0(1)1 r , 

Je-^N W 

POO 

^ (iV~2(i+/3) -|-£j|0(l)| / e rEfe=i®fc)^_2-(i+/3) 

Jo 

that gets arbitrarily close to zero as N approaches infinity and e tends to 0, since the 
integral is hnite due to the fact that 


r(-/3) 




/3 




^ > 0 , 


is the density function of a Gamma distributed random variable with parameters —/3 and 
A(X]^i 6'fc)^/4. This yields (Ib.lOh completing the proof. □ 

Proof of Theorem 14.9L Similarly as in the proof of Theorem 14.81 it suffices to show that for 
any m G N and ,..., 0m ^ ® we have the convergence 


N 


1 -E 



ViVlogiV 


k=l 


X. 



2 



2 


as iV —)■ cx). By applying fl2.4p . the left hand side equals 





1 

> 

+ 

-i- 

A^E 

i - (^ewviogiv ^. 

0 y/N log N 

(yJ 0 (1 —ajv'JV log IV 


= NE 


1 _ = iVy (l- V'(a) da 


with 


BN{a) ^ 


k=l 


0 y/N log N - - 


i9i 


y/NhgN 




/, / - — ^ ^ 

Qp ^ ^0 \/N log N — \/iV log N ^0 \/N log N - 1 ), aG[0 ,l]. 


Just like in the proof of Theorem 14.81 it is easy to see that for any e G (0,1) we have 

(S^rn n \2 

sup |7Vi?^(a)|^%^^0 
ae( 0 ,i-e) 21ogiV 

as N ^ oo. Therefore, by Lemma lB.21 substituting a = 1 — z/N, the statement of the 
theorem will follow from 


(5.13) 


lim sup N 

N^OO 


1—e 


I _ 


ceN 


da = lim sup / 

Af—>00 Jo 




dz < 00 , 
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and 


(5.14) lim N 

N^OO 


/»1 psN \ / 

' j da = ^im / ^1 — j dz = — | ^ 0 , 

i-e -^°°Jo \k=l 


for all £ e (0,1). Next we check fl5.13l) and fl5.14p . 

Using Taylor expansions, similarly as in the proof of Theorem 14.81 we get 

0 ( 1 ) , 0 ( 1 ) 


(5,15) hlB„(l-±)^-h«h + 


Indeed, for z G [0, A^] we have 

m 

-j: 


Bm 1 


iV 


0 \/N log N _ 


2zlogiV .siVV2(logiV)3/2 N\ogN' 


\0k 


k=l 


ViVlogiV 


E 


Z \3 


^ N 


(e^+i+--+e,i) 


E 

k=l 


01 


+ 


2N\ogN {N\ogN)^B J 


^0 y/N log N — 0 y/N log iV ^0 y/N log N — 

0 ( 1 ) \ 




0 ( 1 ) 

N J y^/NlogN ' NlogN 


+ 


X 1 + 


0 ( 1 ) 


Wj 


+ 


0 ( 1 ) 


+ 


E m n2 
k=l 

2N\ogN ' (iVlogiV)3/2 

0 ( 1 ) 


y/NhgN J\^/NhgN N\ogN^ 

0 ( 1 ) 'I2i<^e<j!^m0i0j 0 ( 1 ) 


iVlogiV 

^Q(l) 

2AriogiV ' (AriogiV)3/2 ' Ar2 1ogiV’ 
since, by Bernoulli’s inequality. 


+ 


^Q(l) 

(iVlogiV)3/2 ' iV2 1ogiV 


+ 




+ 


+ 


1 - 

N 


z \j-^ 


^ U ~ ^ m—, 


yielding that 




By fl5.15p . for 2 ; G (O, and for large enough N we have 




2z log N 


Re 0(1) 5^ ^ Re 0(1) 


i/A^ log N J NlogN 


^ KEZiOk) , 


Az log N N log N 


o(i)l ^ KEZiOkf I |0(i)| 


NlogN' 
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hence we obtain 


' 1 
log N 


(5.16) 

Note that 

(6.17) 

(5.18) 


1 






logiV 


1 + exp 




10 ( 1)1 

NhgN 


—!■ 0 as N ^ oo. 


reN 


logN I 1 2 ; 

logiV 


dz = 


log £ + log iV + log log N 
logiV 


—)■ 1 as iV —)■ cx), 


reN 


1 . sN log iV — 1 


. — 

logiV / 1 z‘^ eNlogN 

log N 


^ 1 as N ^ 00 . 


By (!5.15p, for all z e {j^,£N), we have 
(5.19) 


“ iV 


^ a(eLi I 


0 ( 1)1 


+ ^,?^^ = | 0 ( 1 )|. 


2^ logiV ziVV2(iogiV)3/2 iV logiV 


Thns, by (lB.3p and (15.171) . we get 

reN 


lim snp 

N^OO . 




dz 


log N 


reN 


^ lim snp 


N^oo J 1 

log N 


\N ^ , Z \ AiV p /-I _ z \ \ 

- Bn{1 “ jy) ^ 


^ lim snp e 

N^OO 


I 0(1)1 


KEZiO. 


+ 


0 ( 1)1 


+ 


0 ( 1)1 


2^ logiV 2 iVV 2 (logiV) 3/2 iv logiV 


dz < 00 , 


log N ^ 

which, together with fl5.16p . imply fl5.13p . 

Now we tnrn to prove fl5.14p . By fl5.16p . the convergence fl5.14p rednces to prove that 

reN 




A (Er=i hf 


log N 


—)■ 0 as iV —)■ cx). 


Using (I5.17p . it is enongh to check that 




f 1 

log N 


_ 1 + A(£r.i<’tt I 

2z log N 


^ 0 as iV ^ 00 . 
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By applying flB.4l) . fl5.15p and (I5.19p . for large enough N we get 


reN 


dz 

^ log N 

V J 2z log N 







r 

log N 

n 

log N 




1 MET=i&^ 


I 0(1)1 




2zlogAr ziVV2(logAr)3/2 iVlogAry 


N/ 2z log N 


. 10 ( 1)1 




0 ( 1)1 


_ , 10 ( 1)1 

^iVV2(logiV)3/2 iVlogiV 


d^ 


< 


rsN 


f 1 
log N 


0 ( 1)1 


+ 


0 ( 1)1 


+ 


0 ( 1)1 


+ 


0 ( 1)1 


0 ( 1)1 

2 V^2(logiV)2 ' z^N(logN)3 ' iV2(logiV)V ' 2 iVV 2 (logiV) 3/2 ' iVlogiV 


+ 


dz, 


which converges to 0 as N ^ oo using 05.17p and 05.18p . This yields 05.14p completing the 
proof. □ 

First proof of Theorem I4.10L By Proposition 14.21 we have 


[ntj 


Pf-lim n-^ V(^f ^ - E(xf^ I a^^))) 


V^-^(l 


a 


k=l 


teK+ 


1 — 0 


-5, 


where (i?t)t 6 R+ is a standard Wiener process and o is a random variable having a density 
function of the form 04.5p with (3 G (—1,1) and -01 ^ (0) oo), and being independent of B. 

Let Wt '■= t G M+, and (wO) 46 r^, i G N, be its independent copies. It remains 

to prove that 

/ 1 ^ \ 

Vi- lim ( iV W V Wf ^ = W+/ 3 . 

V j ieR+ 

Using the continuity theorem and the continuous mapping theorem, it is enough to prove that 
for all m G N, 6 *i,..., 6 *^ ^ IP and 0 =: to < U < ^2 < • • • < tm, 


N 


E( exp^ i9,1 iV-iM - w';).: 

i=i 


i=l 


E 


(exp I 


i=i 


N 


—>■ EI exp -j i 

i=i 


E ( exp<j i ^ 0jEEi+^(Bt, - Bt^_^] 
i=i 


E ( exp<j - V(i+/ 3)/2 0]{tj - tj-i] 

i=i 


exp< - 




i=i 


l±§_ 

2 


= e 


— fc /5 U) 


l +)3 
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as iV —)■ cx), where cu := ^ Note that, using the independence of a and 

B, it suffices to show 


'^N ■ = 


N 


1 -E 



i=i 



= N 


1 -E 


exp 



'1+/3 A(1 + «)(! — a) 


-2 


i=i 



= N (l-e-"^^ WA(i+a)(i-a) "j^(a)(i_a)/3da^ 

1+/3 

as N ^ oo, since it implies that {1 — ^ as N ^ oo. For all £G(0,1), 

1 2 1 , -1+/3 1 

sup |—1+/3 (1 + a)(l — a) | = uN (2 — e)e ^ 0 

aS( 0 ,l—e) 


as N ^ oo. Therefore, by Lemma [B.21 substituting a = 1 — A^ ^+^ 1 /, the statement of the 
theorem will follow from 


(5.20) 


and 


(5.21) 


limsupAt / 

N —^CXD t/ 1 —£ 


1 2 

—uiN l+? A(l+a)(l—a)“^ 


1 — e 


r-eAiW 


= limsup / 

N^oo Jo 


I _ g-i^A(2-Af ^y)y ^ 


(1 — aY da 
yf^dy < oo. 


lim N 

N^OO 


= lim 

N—^oo 


j (l - (1 - af da 


r-eAfW 


for all £ e (0,1). Next we prove fl5.20p and fl5.2ip . 

For all At G N and £ G (0,1), using (IB.ip . we have 


/•eVW 

1 

pOQ 


X _ g-KiA(2-Af 

/ 

Jo 




r dy 


^ / y^dy + 2u\ / ^d|/<cxo. 


hence we obtain (I5.20p . 

Now we turn to prove (I5.2ip . For all £ G (0,1), we have 


(5.22) 






r dy 


^ 2n;A T , /"My = ^ Q 
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as iV —)■ cx). Further, using flB.3ll . 




1 psN 

('l _ ^-u^Xi2-N-T+Py)y-2^^y0 ^-2a;Ay-= j 


1 _ ^ U,/3 


y dy 


r-eTVW 


< 


^-w\{2-N ^y)y- 


^-2u\y 2 I R 


r d|/ 


r-eArW 


2, o^AJV 1 


eAtW 


^CUAAT-W / ^-2uXy-^^ujXN T+P y '^/3-l 


fe7Vi+? 


r-eArT+P 


^ wAiV" w / '/-i d|/ ^ cuAAT-w / /-i d?/ 


_ 3 _ (eiVW)/^ 

= UlXN 1+^ -- = CjA - ;:; - — ^ 0 US N — ^ CX), 


/d 


hence, using (I5.22p . we conclude 


/d 


r-sACW 


lim 

N^oo 


(l-Q-‘-H2-N-^y)y-^^yfi^y^ f (l - dy 


= -{2uX)^ / (l-e->-^dn = V'r'fc/ 3 a;^, 

2 Jo 

where the last equality follows by Lemma 2.2.1 in Zolotarev [SB], thus we obtain fl5.2ip . For 
the characteristic function of y(i+^)/ 2 , see the second proof. □ 

Second proof of Theorem 14.101 By Proposition 14.21 we have 


[nt] 


V,- lim ( n-'/" J](Af > - E(A'P | a'*))) 


'( 1 ) 


k=l 


4eR+ 


x/ -^(1 + 

1 — a 


QC 


B, 


where is a standard Wiener process and a is a random variable having a density 

function of the form (14.Ah with (3 G (—1,1) and tfji G (0, cx)), and being independent of B. 
Hence it remains to prove that 


lim (r/^LaH. = (VWPmB,) 


where 


A^^OO 


N 


y(Ar) _ VA (1 + 


^ 1 - « 


U) 


t 5 


t G 


teK+ ’ 




iV G N, 
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and j G N, and j e M, are independent copies of a and B, respectively, being 

independent of each other as well. By the continuous mapping theorem, it is enough to show 
that for all m eN and 0 =: to ^ < ^2 < • • • < tm, 

^{N) rpiN) 


r,v' - r;,"',... .r/f - r,A (y5y;yy(B,. - b,.), ..., y5v;yy(B,„ - 


as N ^ 00 . By the portmanteau theorem, it is enough to check that for all m G N, 
0 = to ^ ^1 < ^2 < • • • < tm, and for all bounded and continuous functions g : -E M, 

E (9 . • • ■. hr’ - hr.’. >) 

IE, (^f (\/h(i+/3)/2(-Bti - Bto ),..., ^/y{l+|3)/2{Btm - 

as iV —)■ cx). Since 

Eh(r<r' - hr’, ■ ■ ■, hr’ - hr*.)' 


= E 


= E 


= E 


E 




j E N 


\ 


_ 2 _ ^ A(1 + ad)) ~ ~ 

^ Y1 (1 - ad))2 ~ ■ ■ ■ ’ 

7 = 1 ^ ^ 




_ 2 _^A(l + ad)) ~ ~ 

^ (1 - ad ))2 ~ 




where (i?t)tgR+ is a standard Wiener process independent of ad), j e N, and h : -E- 

is an appropriate bounded and continuous function. Hence it is enough to prove that 

A(1 + ad)) x> 


(5.23) 


1 




y{i+ 0)/2 as N ^ 00 , 


i.e., it suffices to show that belongs to the domain of normal attraction of the ^^-stable 

law of h(i+^)/ 2 - Indeed, then, by the continuity theorem, 

N 




V 


{Y{i+l 3 )/ 2 ,Bt^,...,Bt^) as iV —)■ cxo. 


where we additionally suppose that {Bt)t£R+ is independent of Y(i+/ 3)/2 as well. Hence, using 
again the portmanteau theorem. 


E 


, 2 ,AA(l + ad)) ~ 




^ E 
= E 


h{Y(^i+p)/2, Btj^,..., Bt^) 

g{^/Yii+l3)/2{Bt^ - Bta),..^yY(^l+|3)/2{Bt^ - Bt^_^) 
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as iV —)■ cx), as desired. Note that 


lim |x| 2 P 

x—)•—OO 




(l-a)= 


and 


lim a: 2 p 


(1 -a )2 


> a; = 


V^i( 2 A)' 2 '' 

1 + /3 


Indeed, the first convergence follows immediately due to the positivity of and using 

that 

+ =9\( (J—-1.Y-1- 

l-a 4/ 16 


(1 -a )2 

and ^1, we have for all x > 0, 
A(1 + a) 


{1-ay 


> X 


a> 1 


i + V li + 


=: 1 — h(A, x), 


and hence 


1+/3 ™ 

X 2 P 




\{l-ay 

/•^/xh{X,x) 


a ) \ 1+/3 

> X = X 2 


' l—h(\,x) 


(1 — aYip{a) da 


/'^(l - d|/^-01 / y^dy 


V^i(2A) 


1+/5 


1 + /3 


as X ^ oo, 


as desired. Indeed, one can use the dominated convergence theorem, since there exists e G (0,1) 
such that |'0(^) “ t/^i| < 2'0i for all x G (1 — e, 1), and ii y E {0, y/xh{\,x)), then 
1 — G (1 — h(A, x), 1) and hence, for large enough x, we get 

■ 0(1 - ^ SV'i, 1 /G (0,x/xh(A,x)). 


Since ^/xh{X,x) ^ \/^, x G M++, this yields that y^j(|/), y G M+, serves as 

an integrable dominating function for large enough x. Consequently fl5.23p holds, see, e.g., 
Puplinskaite and Surgailis [27l Remark 2.1]. Indeed, the characteristic function of the random 
variable Y(i_|_/ 3)/2 takes the form 

E(e‘^Ri+/3)/2) 


= exp < -|0| 2 


1+/3 r (2 


2 ^ 


i-i±^ i + y 


^i(2A)^ / /^(l + /S)\ . . . /vr(l + /3) 

' cos I -^- I — isignffc*) sm ' 


= exp 






9 G 
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This can be also seen using, for example, Theorem C.3 in Zolotarev [38] (with the choices 

□ 


a = /3 = 1 , 7 = 0 and A = kp). 


Proof of Theorem 14.111 Since E(y^) < C) 0 , by Proposition 14.11 we have 


g(N) as AT ^ oo. 


^/N 


where the strictly stationary Gaussian process {yk)k&'L+ is given in Proposition ITTl Conse¬ 
quently, by the continuous mapping theorem, for all n G N, we get 


Vr lim = ^- 1/2 

V k=l 

and hence it remains to prove that 


\nt\ 




\nt\ . 

aB 


as n —)> 00 . 


k=i / tm+ 

Since the processes Z]i=i n G N, and aB are zero mean Gaussian processes, 

it suffices to show that the covariance function of X]i=i ^fc)i 6 R+ converges pointwise to 

that of aB as n —)■ cxo. For all 0 ^ ^ t 2 , 


/ lntl\ lnt2i s , /lntiilnt2i |fc_£| \ 

^ k=l k=l ^ \ k=l e=l / 


^ AE 


1 T cr 


(1 -a )2 

since one can use the decomposition fl5.7p together with 

1 — 1) -I- ([nt 2 j — L’^Gj)(l — «^)/2 


min(ti,t 2 ) = Cov{aBt^, aBt^) as n —?> 00 , 


n 


(l-a)= 


—>■ (^2 ~ ti) E 


1 -|- tt 
2(1 -a)2 


as n ^ 00 . Indeed, by the dominated convergence theorem. 


1 - 1 ) 


n \ (1 — a)^ 

where the pointwise convergence follows by 

a(aL"*2j-GtiJ _ x) 


^ 0 


as n —)■ 00 , 


< 


(l-a)3 '^(l-a)3’ 

and (^2 — ti + 1) serves as an integrable dominating function, since, by Remark 14.51 

((T^) < and 

a(aRt2j-GiiJ _ 1) 


E 


1 

n 


{1-aY 


0^(1 “ t “ oY -|- * * * “ 1 “ q ; 




< 


n{l — a )2 
Q!([nt2j - [nti\) 


n(l — ay 


^ (^2 ~ + 1 ) 


a 


{1-ay 
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For the second convergence, first note that, by Proposition 14.21 we have 


Vf- lini 


\nt\ 

1 




(b I ^(1) 




V -^(1 + 


a 


teR+ 


1 — a 


-B, 


where is a standard Wiener process and a is a random variable having a density 

function of the form (14.5^ with P G (1, C)o) and xpi G (0, oo), and being independent of B. 
Hence it remains to prove that 


Vf- lim 


N^oo ^ 1 

V , = 1 


-\/A(l + j^(j) 

^ 1 — ab) 


= aB, 


where j g N, and j g are independent copies of a and B, respectively, 

being independent of each other as well. Similarly to the second proof of Theorem 14.101 it is 
enough to show that 


1 A A(1 + a(b) ^ ^ 

n - ^ ^ 


^ (1 - 


as N ^ oo. 


This readily follows by the strong law of large numbers, since E () < oo due to Remark 

m 


□ 


Proof of Theorem 14.121 We have a decomposition 


(5.24) 

with 




{N,n) 


= R 


{N,n) ^{N,n) 


t G 




R 


{N,n) 


N lnt\ 




b) I Q,b) 


E(.Yy)) = L«(J E ( TV 


N 


A 


1 — aR 


E 


A 


1 — abl 


j=i k=i j=i 

for t G M+. By Theorem 14.71 for each n G N, 'Df-limTv^.oo exists, hence 

(5.25) Vi- lim = Vf- lim = Q. 

N^oo N^oo 

The distribution of the random variable A(1 — a)~^ — E(A(1 — a)”^) belongs to the domain of 
attraction of an (1 + /3)-stable distribution. Indeed, we have 


lim P 


A 


E 


1 — a 

= lim P I a > 1 — 

X—^OO 

1 


A 


1 — 0 


> X 


= lim 


X yi-(A-ix+E((l-o)-i))-i 


A-ia: + E((l -o)-i), 

— aY da 


= lim 

X^OO 


- (A-^x + E((l - o)-i))-i)(A-^x + E((l - o)- 1))-^-2A-^ _ V'iAi+^ 

-(l + /3)x-d+^)-i “ l + (5 
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by L’Hopital’s rule. Further, using that P(A(1 — a) ^ > 0) = 1, 


lim 

tc—)•—oo 


A 


1 — a 


-E 


A 


1 — a 


< x I = lim -0 = 0. 


Consequently, for each n G N, 

A-Jta AT-™«(«.») = 


see, e.g., Puplinskaite and Surgailis [23 Remark 2.1], Indeed, the characteristic function of the 
random variable takes the form 


E(e 


wz 


1+/31 


= exp -\e\^+^ 


r(2-(l + /3))^iA^+/^ f _ f7r{l + /3) 
1 — (1 + / 3 ) 1 + /3 


cos 


— isign(6') sin 


7r(l + /3) 


= exp { - 


= exp<{ - 


9eR. 


Together with fl5.25p . we obtain the hrst convergence. 

By Theorem 14.101 for each iV G N, "Df-lim^^oo exists and hence 

Pf-lim ='Df-hm n~^n~^= 0, 


and 


N 


A-lim = U (-— - E (-: 

n-s-oo \ ^ \ 1 — Q/0) \ 1 — 


i=i 


A 


A 


1 — ad) 


teK+ 


Based on the above considerations, using the decomposition (I5.24p as well, we obtain the second 
convergence. □ 

Proof of Theorem 14.131 First note that, since (3 > 1, by Remark IT751 Var((l — a) ^) < oo. 
Hence, by the central limit theorem, for each n G N, 


A- lim = (LnfJfF, 2 var((l-a)-l)) 

N^oo ' 


teK+ 


Consequently, 


A-lim A-lim n = (kF;,2var((i-a)-i)^)teK+- 


n—>-oo N—>-oo 

By Theorem 14.111 A-lim„^oo A-lim 7 v^.oo exists, hence 

A-lim A-lim n~^N~2 = Vf-lim A-hm n~2 (nN)~2 = 0. 

n—>-oo N—^co n—^oo N^oo 

Using the decomposition fl5.24p . we have the hrst convergence. 
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Similarly, for each iV G M, 


N 


Pf-lim = V 

n—^oc) \ f ^ 

0 = 1 


A 


E 


1 — a(-^) V 1 — 


A 


ieR+ 


and, by the central limit theorem, 

Pf-lim Pf-lim var((i-a)-i)^)teK+- 

N^oo n^oo 


By Theorem 14.111 we also have 

A-lim Pf-lim = o, 

N^oo n—>-oo 

which yields the second convergence using the decomposition (15 .24^ as well. 


□ 


Appendices 

A Non-Markov property of the randomized INAR(l) 
model 


The aim of this appendix is to show that the randomized INAR(l) process (Xk)kez+ dehned 
in Section |4] does not have the Markov property provided that a is non-degenerate. We show 
that if a is non-degenerate, then 

P(X2 = 0 I Xi = l,Xo = 0) ^ P(X2 = 0 I Xi = 1), 

implying our statement. By the strict stationarity of (Xk)kez+, the conditional independence 
of El and Xq given a, and fl4.ip - fl4.3p . we have 


P(X2 = 0 I Xi = 1) = P(Xi = 0 I Xo = 1) = 


P(Xi — 0,Xo — 1) P(^i,i — 0,£i — 0,Xo — 1) 


P(Xo = 1) P(Xo = 1) 

/q P(^i4 = 0, = 0, Xq = 11 q = g) P^(da) 

Jp P(Xo = 1 I a = a) Pa (da) 

Jg P('Ci,i = 0 I a = a) P(£i = 0 I a = a) P(Xo = 11 a = a) Pa(da) 


Jq P(Xo = 11 a = a) PQ(da) 


/o(l -a)e ^^e i- Pa(da) 


1 -a-t^ 


Pa (da) 


1- Pa(da) /o Y^e i- Pa(da) 
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Similarly, we have 


P(X 2 = 0|Xi = l,Xo = 0) 


P(X2 = 0,Xi = l,Xo = 0) _P(6,i = 

P(Xi = l,Xo = 0) 


: 0,£2 — 0 ,£l — 1,^0 — 0 ) 

P(ei = 1, Xq = 0) 


/q^( 1 — a)e ^Ae '^e i-“ PQ,(da) —a)e ^ i-“ PQ,(da) 

Jp^Ae^^e”!^ Pa(da) PQ,(da) 


By Cauchy-Schwarz’s inequality, we have 


/ e i-“ PQ,(da) j ^ j (1 — a)e 


pi \ ^ 

/ A . , X \ / 


A 

1 —a 



Pa (da). 



Jo 


1 — a 


and equality holds if and only if there exists some positive constant C > 0 such that (1 — 

A A 

a)e i-“ = Cj:^e i-“ P^-almost every a G (0,1), which is equivalent to the fact that there 
exists C G (0,1) such that Pq, is the Dirac measure concentrated on the point 1 — y/C. 
Consequently, P(A '2 = 0 | Xi = 1, Xq = 0) ^ P(-A 2 = 0 | Xi = 1) and equality holds if and 
only if Pq is a Dirac measure concentrated on some point in (0,1), i.e., a is degenerate. 
Hence if a is non-degenerate, then the randomized INAR(l) process {Xk)k£Z+ does not have 
the Markov property. If a is degenerate, then {Xk)kei,+ is a usual INAR(l) model being a 
Markov chain. 

B Approximations of the exponential function and some 
of its integrals 

In this appendix we collect some useful approximations of the exponential function and some 
of its integrals. 

We will frequently use the following the well-known inequalities: 

(B.l) 1 — e“^ ^ x, x G M, 

(B.2) |e'“ —1 |^|m|, |e'“ — 1 — m| ^ m^/2, m G M. 

The next lemma is about how the inequalities in flB.2p change if we replace m G M by an 
arbitrary complex number. 

B.l Lemma. We have 


(B.3) 


e 


- 1| ^ k|e'^'. 


z G C, 


(B.4) 


up 

e^ - 1 - ^1 ^ ^e'"' 


2 


zeC. 
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Proof. For any 2 ; G C we have 


|e^-l| = 




‘ + ^ + ¥ + '" 


III \z\ \z\ 

+IT+ 


s;kili + ^ + ^ + ^^h = ki<='''. 


|e^ - 1 - ^1 = 




2 ! +¥ + ■■■ 


< 


\Z\ 

~Y 




\z\ 

~2 




since 3 • 4 • • • (n + 2) ^ n! for any n G N. 


□ 


B.2 Lemma. Suppose that (0,1) 9 x 'ijj{x){l — x)^ is a probability density, where is a 
function on (0,1) having a limit lima;-|-i ■j/'(a;) = '0i G (0, cxo) (and necessarily (3 G (—l,cxo)j. 
For all a G (0,1), let (-SAf(a))AfeN be a sequence of complex numbers such that 


(B.5) 


lim sup \Nz]\[{a)\ = 0 for all e G (0,1), 

ag(0,l-£) 


lim sup N 


f 

1 _ 

h-£o 



lim lim sup 

£'4'0 A^—>cxd 


N 


(1 — aY da < 00 for some £0 £ ( 0 , 1 ), 

I (^ 1 ( 1 -a)^da-J 


= 0 


with some / G C. Then 

lim TV 1 - ) V^(a) (1 - af da = ifil. 


N^oo 



Proof. Using dominated convergence theorem, hrst we check that 


(B.6) 


^im iV [ j'0(a)(l “ da = 0 for all eG(0,l). 


By applying (IB.311 and using (lB.5p . for any £ G (0,1) and a G (0,1 — e), we get 
(B.7) " A 


N - 2 ^(a) ^ 0 

V / 1 — a 

as N ^ 00 . Further, if £ G (0,1) and a G (0,1 — e), then 

AT (1 - < - sup sup |iv.s^(a)| =. c, 

V J e AreNae(0,l-e) 

where G M+. Since — a)^ da = 1, we have 


N f (^1 - jp(a)(l - af da 


'‘I —£• 


< 


C£'^(a)(l — aY da < 00 . 


44 
























Therefore, (0,1 — e) 3 a i-)- Csip{a){l — a)^ serves as a dominating integrable function. Thus 
the pointwise convergence in (IB. 71) results (IB.6p . Moreover, for all £ G (0,1), we have 


where 


N 


N (V'(a)-V'i)(l-a)^da 

(^1 _ j (1 -a)^da-J 


“1—e 

) 

r-1 

<l-e 


+ V'l 


N (V^(a)-V'i)(l-a)^da 


sup \'ip{a) —'ipi\ 

aS[l—£,1) 


f 

1 _ 

n-e 



(1 — aY da. 


with sup„g[]^_^ |'0(a) —'0i| —t 0 as e J, 0, by the assumption. First taking limsup^^o^ 

then e J, 0, using (IB.6p . we obtain the statement. □ 


C A representation of fractional Brownian motion due 


to Pilipauskaite and Surgailis [23 


We recall an integral representation of the fractional Brownian motion with Hurst parameter 
in (|, l) due to Pilipauskaite and Surgailis [23] in order to connect our results with the ones 
in Pilipauskaite and Surgailis [23] and in Puplinskaite and Surgailis 

For all {3 G (0,1) let us consider the stochastic process given by 


(C.l) 

where 

(C.2) 


:= / s) - f{x,-s)) Z{dx,ds), t G M+, 


f{x,t) := 


(1 — e ®*)/x if x G M++ and t G M++, 
0 otherwise. 


with respect to a Gaussian random measure Z{dx, ds) on M+ x M with zero mean, variance 
i^(da;,ds) := (2 —/9)(1 — 13)/V{l3)x^ dx ds and characteristic function 

for each Borel set A C M+ x M with z/(H) < oo and 6 eM.. Note that, by Pilipauskaite and 
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Surgailis [23l page 1014], is a fractional Brownian motion mnltiplied by some 

constant. In what follows we check that this constant is in fact one. It snffices to show that the 
variance of the process dehned in fIC.lIl at time 1 is 1. By fIC.ll) and flC.2ll (see also formnla 
(2.4) in Pilipauskaite and Snrgailis |23]) one can easily see that the variance of takes 

the form 

(2-/3)(l-/3) 


^oo poo 


where, for x G M++ and t G M+, 


(/(x, 1 — s) — f{x, —s))^ x^ ds dx. 


'0 J —oo 


(/(x, t-s)- f{x, -s)) V ds 


' —OO 

rO 


I _ Q-xit-s) _ g-a;(-s) 


X 


X 


X' 


^ ds + 


* /X _ Q-x{t-s) 


X 


X 


^ds 


J2xs 


(1 - e-^*) V-2 ds + / (1-e-^(*-"))V-2ds 


= -(1 - e-^*) V-3 + / (1 - ds. 

2 Jo 

Hence, with repeated partial integration, we have 




r(/9) J 

m J 

{2-m-d 1 

r(/3) 2-/3 

(2-/3)(l-/3) 


r(/3) (2-/3)(1-/3) 


;(1 - e-^) + / (1 - V-Ms 

(e”"^ — 1 + x) x^“^ dx 

poo 

+ l) x^“^ dx 

= 1 , 


dx 


Jo 

r(/?) 


as desired. 
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